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IWTBODqCTlOH 


AeauaptloM 


In  thla  aeiBoruidum  it  is  asauasd  that  a qvsstionnalra  is  to  ba 
used  to  slicit  Information  on  eartain  topiest  and  that  tha  raadar 
will  ba  a naabar  of  tha  Triala  Taam  rasponaibla  for  conatrueting  and 
using  tha  quastionnaira. 


Ganaral 

A quastionnaira  is  an  inatrumant  for  convaying  a raspondant's 
opinion  on  a topic  to  tha  queationar  with  tha  ainiaum  loss  of  inforaa- 
tion  and  with  tha  naximun  clarity.  It  may  ba  tha  sola  sourca  of  such 
infonation  (ag  information  on  comfort)  or  it  aay  ba  osad  to  eompla- 
nant  objactive  information  from  othar  aourcaa  (ag  alrcraw  opinion  on 
a particular  Itaa  of  aquipsMnt  is  usad  to  eomplamant  objactira  data 
as  to  how  wall  that  aqulpmant  functions  in  practles).  Quastionnairas 
ara  usually  chaap«  sinpla  and  affactlva  but  ara  always  opan  to  a 
number  of  biases  such  as  those  producad  by  conscious  mls-raporting» 
distortions  of  manory  or  by  tha  undue  influence  of  tha  Trials  Team. 

A poor  quastionnaira  will  lead  to: 

a.  Falsa  information 

b.  Insufficient  or  impraeise  information 

c.  Wasted  effort 

d.  A bad  recaption  for  any  further  studios. 

Where  at  all  possible t a mambar  of  the  Trials  Taan  should,  in 
tha  early  stages  of  planning  a questionnaire,  have  an  informal 
discussion  with  sons  of  its  intended  recipients  in  order  to  gain  an 
imprassion  of  tha  language  which  they  lua,  tha  type  and  level  of  tha 
information  which  they  will  ba  able  to  provide  and  tha  issues  which 
they  believe  to  be  IniMrtant. 
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Bafor*  atartlag  to  eoaplla  a quaatloiiaalra  tha  Triala  Taaa 
ahould  ba  abla  to  anawar  tha  following  quaatioaai 

a.  What  praeiaaly  ara  tha  faetora  about  which  iafoiaation  ia 
balag  nought? 

b.  for  what  purpoaaa  ara  tha  anawara  aaadad?  Ara  thay  to  ba 
uaad  aa  a baaia  for  daeidiag  batwaan  two  or  aora  itaaa  of  aqnip- 
aaat  (ia  a 'count  of  haada')  or  ara  thay  aaraly  aaaking  infomation 
on  aa  iaaua? 

c.  What  typa  and  fora  of  anawara  ara  azpaotad? 

d.  What  analyaia  will  ba  parforaad  on  tha  data?  Thia  daciaioa 
ia  aoat  inportant  aa  far  too  aaay  qnaationnalraa  bara  itaaa  which 
allow  a ohoiea  of,  aay,  aaran  raaponaaa  to  a particular  quaotion 
which  ara  than  proaptly  coUapaad  into  thraa  catagoriaa  in  tha 
analyaia,  ao  loaing  data  and  waatlag  affort.  It  would  hava  baan 
far  battar  to  hara  uaad  thraa  catagoriaa  ia  tha  flrat  placa. 

Tha  vary  difficult  problan  of  aMaariaiag  opan-andad  quaationa 
will  ba  diacuaaad  in  tha  Analyaia  Suction  (aaa  page  15). 

Profaaalonal  Halp 

Lika  aaay  coaplax  iaatruaanta,  a quaationnaira  appaara  to  ba  aaay 
to  eonatmet  and  uaa  but  ia  fact  it  raquiraa  a graat  dual  of  cara. 
Whanawar  poaaibla  it  ahould  ba  diacuaaad  at  an  aarlr  ataita  with  a 
payohologiat  who  baa  azpariaaea  la  thia  fluid,  juat  aa  tha  daaign 
and  analyaia  of  tha  tidal  ahould  ba  ohackad  with  a atatiatician. 

HowoTur,  although  tha  paychologiat  can  halp  conaidarably  in  daciding 
how  to  aak  quaationa,  you  auat  know  what  yon  want  to  aak,  in  do  not 
aak  tha  paychologiat  aaraly  to  'Daaign  a quaatioanalra  for  a trial  on 
a particular  Itan'  - ha  cannot! 


Pai*  3 


Probably  taa  b«at  preeadora  for  soMona  wrltias  thalr  first 
quastionaalra  ia  to  prapara  a draft  of  all  tha  quaaiiuna  wbleh  thay 
wish  to  laelnda  and  to  aak  a pajehologlat  to  co—aat  on  tad,  if 
aaeaswury,  aodify  tha  draft.  Tbraa  vary  naafnl  basic  rtfaraaeas  ara 
listad  at  tba  aad  of  this  aaaoraadaa,  that  by  Oppaahaia  baiai 
partieolarly  racoaaaadad  (aaa  pass  17). 


COWSTKOCTIIIQ  A QPBnomiBI 


Thara  ara  baaieally  two  typos  of  quaatioa  a*td  ia  a qaastioa- 
aaira,  *opaa-oadod'  aad  'foread-cboica*.  Tha  fonar  typa  ia  iUaatratad 
by  itaaa  such  as  'What  do  you  thiak  about  ....?'  whora  tha  raapoadaat 
ia  fraa  to  uaa  his  owa  words  to  raply,  wharaaa  ia  tha  lattar  typa  of 
quastioa  tha  raapondaat  is  aithar  aakad  to  ehoosa  oaa  oat  of  a list 
of  posaibla  aaowors  (di«ital)  or  to  aark  a liaa  wboaa  aad-poiats  ara 
dafiaad  (aaalogua).  Tha  aajority  of  qnastioaaairas  will  probably  eoataia 
both  opaa*aadad  aad  foread-eboiea  qaastioas  aad  dua  ears  will  hawa  to 
ba  takaa  to  aaa  that  thoy  ara  aaalysad  diffaraatly. 


bTias  eollactod  togathar  all  tha  qaastioas  which  they  wish  to 
ask  tha  raapoadaat^  tha  Mals  Toaa  should  (iva  attaatioa  to  tha  actoal 
wordios  of  thoso  qaastioas.  Pracisa,  claarly-wordad  qaastioas  will 
olieit  elaar  aasworsi  aobigaoas  or  poorly-wordad  qaastioas  will  aost 
cortaialy  produca  aabiqaous  aad  osalass  aaswars.  Vhaa  daoidiac  oa 
tha  wordiac  of  say  itas,  thraa  priaeiplss  should  ba  obaarrad. 

Thay  arss 

a.  Politaaass.  Qaastioas  should  always  ba  'raspoadsat  oriaa- 
tstad',  that  is  thay  should  ba  wordad  for  tha  coaTsaiaaca  of  tha 
raspoadsat.  Thay  aost  usa  tha  words  which  those  who  ara  to  reply 
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to  the  queationoelre  woxild  nonnallj  uaet  which  will  not  necessarily 
be  those  of  the  Trials  Tean.  The  aim  is  to  motivate  the  respon- 
dents to  give  the  moat  clear  cmd  honest  answers  of  which  they  are 
capable.  Such  a response  will  not  be  engendered  by  curt  instruc- 
tions, irrelevant  or  apparently  irrelevant  questions,  or  a badly 
laid-out  questionnaire.  The  use  of  the  word  'please',  if  not 
overdone,  coupled  with  a modicum  of  discreet  flattery,  should 
encourage  clear  and  honest  answers. 

b.  Clarity.  It  is  all  too  easy  to  assume  that  the  person 
answering  the  questionnaire  will  'know  what  the  writer  is  getting 
at'.  Such  an  assumption  is  often  shattered  by  the  arrival  of 
the  first  few  completed  questionnaires.  Great  care  should  be 
teiken  to  avoid! 

(1)  Double  Questions.  For  example,  'Did  you  find  the  boots 
comfortable  or  would  you  rather  they  were  changed?'.  The 
answer  'yes'  here  would  be  ambiguous.  Instead  these  should 
be  written  as  two  separate  questions. 


(2)  Negative  Questions.  For  example,  'Don't  you  feel  that 
there  isn't  a future  for  Instead  this  should  be 

written  as  'Do  you  feel  that  there  ia  a future  for?'. 


(3)  Ambiguous  Boundaries.  Avoid  divisions  such  as 
0 - 10,  10  - 20  , 20  - 30.  These  should  be  written  as 
0-  10,  11  -20  , 21  - 30.  Similarly  the  question  'How  long 
have  you  been  on  the  Squadron?'  could  produce  such  answers 
as  'Over  two  years',  'One  year  and  thirty-three  days', 

'Since  I got  back  from  lunch',  or  'Too  long'.  One  way  of 
overcoming  this  problem  is  to  offer  the  respondent  clearly 
defined  categories  and  to  state  the  unite  in  which  you  require 
your  answer,  eg  if  you  really  wish  to  know  the  sortie  length 
in  terms  of  hours  and  minutes  then  put  in  the  answer  space 
' . . . . hrs  ....  mins ' • 


(4)  AbbfTiatloM.  Avoid tiMS*  unl«M  you  iuiT*  firat 
spollad  thM  out  In  full.  Abbrovlatioaa  My  b«  vary 
faniliar  to  you,  for  anuq^la  you  My  taava  workad  on  tha 
SR5  (awaat  raaiatant  aock)  for  May  yaara,  but  tha 
abbravlation  nay  ba  antlraly  aaw,  and  hanca  Maainglaaa, 
to  tha  raapoadanta. 


It  la  battar  to  arr  on  the  aide  of  axcaMiva  clarity,  aad  ba 
aceuaad  of  pedantry,  than  to  write  a aliok  quaatlonaaira  which 
alleita  maanlaglaaa  roapouMS.  Tha  raapoadanta  nay  well  ba 
filling  in  tha  quaatlonaaira  at  tha  aad  of  a tiring  and  atroMful 
day  whan  thalr  concentration  will  ba  at  a fairly  low  abb,  their 
taapar  frayed  and  thair  patience  eroded. 


c.  gaimaaa.  or  Obiactivitv.  If  a question  is  not  oonplataly 
fair,  tha  data  obtained  froa  it  are  aot  worth  having.  The  writer 
of  tha  question  nuat  never  laflueaca  tha  raapoadant's  opinion  by 
giving  an  indication  of  which  raapouM  is  'better*  or  is  tha  one 
pref erred  by  the  Trials  Teas.  It  is  the  subtle,  rather  than  tha 
glaring,  axanples  of  bias  which  are  the  problM.  Few,  if  any, 
people  would  write  a quaatioa  in  tha  fora  of  'Tou  do  prefer 
Brand  X don't  you?',  but  aaay  lead  tha  respondeat  in  subtle  ways. 
Ibr  example,  the  respondent  is  asked  to  eoapara  tha  'standard' 
item  of  aquipMnt  with  the  'new',  'improved',  or  'rasoaroh-provan' 
item  which  has  tha  'Oood  BouMkaepiag'  msI  of  its  aponsora 
amblanonad  all  over  it.  The  questionnaire,  briefing  and  itsM 
to  ba  evaluated  must  all  appear  in  a strictly  neutral  guise. 


Principles.  Thera  is  no  one  correct  forMt  for  a 


qusstionMlra,  but  certain  prinoiplas  have  bean  found  to  aid 
efficiency.  n>oM  principles  are  that! 
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(1)  The  firat  lapraMioa  of  tho  qMstioBaairo  ahould  bo 
that  it  la  roloraat,  elaar  and  aaaf  to  eoaplato. 


(2)  Iho  qaoatioaaairo  ahould  ha  aa  hrlaf  aa  poaaibla. 
Qttoationa  ahould  bo  iaeludad  oaly  If  thay  ara  raallj 
aaeaaaarj  aad  aot  oa  tha  gronada  that  tho  iaforaatioB  alght 
tun  out  to  ba  uaafUl  for  aoaa  pnrpoaa  at  aoaa  tiaa  la  tha 
ftttaroT 

(3)  Tha  quaatloaa  ahould  follow  aaeh  othar  ia  a logleal 
ordari  thua  holplag  tha  raapoadaat  to  thlak  eloarly  about 
tho  topic. 

Alwajra  raaaabar  tha  'halo*  affaet  ia  which  tha  raapoadaat'a 
attituda  to  oaa  itoa  will  carry  orar  to  adjoiaiag  itoaa.  Thua,  if 
ha  haa  baaa  axpraaaiag  a poaitlva  attituda  to  a aarioa  of  Itaaa 
ha  will  ba  pra-diapoaad  to  aaepraaa  a poaltiTo*  rathar  than  a 
Bogativot  attituda  to  tha  aaxt  Itaa  oa  tha  liat.  To  proToat  thia 
it  ia  a good  pnetlea  to  altaraata  itaaa  oa  which  poaitiTo  aad 
aagatlva  attitudaa  ara  aapaotadt  alwaya  of  oouraa  taUag  groat 
cara  to  aaa  that  tha  itoaa  ara  rary  claarly  wordad.  Ihoro  will 
alao  ba  a taadoacy  for  a raapoadaat  to  giro  alailar  ntiaga  to 
faoton  which  ha  faala  ought  to  ba  poaitiraly  corralatod  ouch  aa 
fabric  weight  aad  warath.  Siailarly,  it  has  baaa  abowa  that 
paopla  toad  to  chooaa  the  firat  aad  1 a a t itaaa  ia  a liat  aora 
oftaa  thaa  tha  othora. 

b.  Saaoiflc  Ibcbaiouaa 

(1)  yvMwl  Quaatloaa.  Oaa  toehaigua  uaad  to  ordar  guaatioaa 
ia  to  go  froa  tho  gaaeral  to  tho  apaolfio.  Ibua  the  opaaiag 
quaatioaa  will  uh  about  tha  itaa  of  aguipaoat  ia  gaaaral 
taiaa  aad  tboaa  will  ba  followed  by  quaatioaa  oa  apacifio 
faaturaa  of  tha  aquipaeat.  Bariag  obtaiaad  opiaioaa  oa 
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tliesa  apecific  laaaaa  It  la  a good  idaa,  wheneTer  poaaible, 
to  conclude  with  a 'verdict*  quaatlon  in  which  the  raapon- 
dent  ia  aaked  to  coomlt  himaelf  to  an  overall  opinion  on 
the  aquipaent. 

(2)  Filter  Queationa.  A aecond  technique  la  to  uae  filter 
queationa  whereby  the  Iteaa  to  which  a reapondant  rapliea 
depend  on  hia  anawera  to  prevloua  iteiUt  eg  'If  you  have 
anawered  'yea'  to  Quaatlon  7«  pleaae  explain  why  you  feel 
that  if  you  have  anawered  'no'  pleaae  go  on  to 

Queation  9«  Filter  queationa  require  very  cleBO*  Inatructiona 
aa  to  the  alternative  procedurea. 

c.  Propoaed  Layout.  The  queationnaire  ahould  he  headed  with 
the  title,  data  and,  if  neceenary,  the  appropriate  reference 
nunber  of  the  trial.  It  nuat  alao  contain  aufflcient  information 
to  define  who  did  what,  where,  when,  for  how  long,  in  what  and 
with  what.  For  a alnple  evaluation  of  a piece  of  aircrew  equip- 
ment a aui table  order  for  queationa  night  be: 

(1)  Biographical  Quejtiona.  For  example,  name,  aircraft 
typo,  dutiea,  flyirg  houra  on  type,  aine,  weight  (if  relevant) 

etc. 

(2)  Background  Queationa.  For  example,  today 'a  date,  datea 
covered  by  the  queationnaire,  trial  location,  experience  with 
type  of  equipoient,  triala  equipment  Serial  Number  etc.  If  aa 
individual  aortle  queationnaire  in  uaed,  the  approximate  time 
of  take-off  may  be  required  to  tie  in  with  meteorological 
data  on  temperature  and  humidity. 

(3)  Factual  Queationa  on  the  Trial.  Fbr  example,  length  of 
tine  for  which  the  equipment  waa  uaed,  longeat  contlnuoua 
period  of  uae,  etc. 
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(4)  Qeiieral  questiona  on  the  •qulpment. 

(5)  Detailed  queetiona  on  the  equipment. 

(6)  A verdict  qneatlon  in  which  the  respondent  ia  naked  to 

give  hia  overall  opinion  on  the  item  or  chooae  between  two 
or  more  itena.  It  na;  be  uaeful  to  add  another  categorji  eg 
'some  other  item  i ],  pleaae  deaerlbet  

(7)  A 'aweeper*  question  in  which  the  respondent  is  given 
apace  to  make  or  amplify  any  points  which  he  feels  to  be 
important  and  which  were  not  covered  elsewhere  in  the 
questionnaire.  For  exaueple  a good  'sweeper*  question  night 
be  'If  you  were  responsible  for  the  further  development  of 
the  SSS  what  changes«  if  any«  would  you  make?' 

NB:  If  the  trials  design  requires  interaMdlate  or  sortie 

questionnaires  it  say  be  decided  that  details  which  do 
not  change  need  not  be  repeated,  eg  age,  rank  etc. 

However,  dates,  tines  and  locations  should  be  on  every 
questionnaire  together  with  some  neans  of  linking  it 
easily  with  the  main  questionnaire. 

Layout  of  the  Questionnaire 

The  basic  principle  for  laying  out  a questionnaire  is  that  it 
should  provide  the  least  possible  work  for  the  respondent  and,  as  a 
secondary  aim,  for  the  person  who  has  to  analyse  it.  This  goal  is 
usually  jcbieved  through  careful  preparation  of  the  questionnaire 
with  due  consideration  being  given  tot 

a.  Numbering  all  the  questions  so  that  items  are  not  omitted. 
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b.  Giving  the  respondent  clear  instructions  as  to  how  to  indi- 
cate his  answer.  Thus  if  you  wish  a tick  C/')  to  Indicate  'yes' 
or  the  answer  of  choice,  oay  so. 

. Laying  down  clear  procedural  instructions.  Por  example,  if 
only  navigators  are  to  answer  Section  B,  then  this  must  be  stated 
together  with  an  instruction  as  to  what  non-navigators  are  to  do. 

(1.  The  careful  allocation  of  space.  Nothing  is  more  annoying 
to  the  respondent  than  having  to  squeeze  a lot  of  information 
into  too  small  a space.  Thus  'John  Smith'  may  be  satisfied  with 
the  space  available  for  hla  name  while  ' Reginald  Barrington-Smythe 's' 
attitude  to  the  whole  questionnaire  will  be  soured  by  having  to 
cram  auch  a fine  name  into  so  small  a space.  The  amount  of  apace 
provided  for  the  answer  v.lll  often  be  taken  by  the  respondent  to 
indicate  the  length  of  answer  which  is  being  sought  and  provision 
has  to  be  made  for  people  with  large  handwriting  who  use  a felt 
pen.  The  respondent  may  be  invited  to  write  on  the  back  of  the 
questionnaire  if  he  requires  further  space  for  any  particular 
response  or  to  attach  an  additional  sheet. 

e.  Efficiency  and  clarity  can  be  aided  by  giving  the  respondent 
a aeries  of  response  boxes  down  the  x^ght  hand  side  of  the  page. 

The  advantages  of  thi  approach  are  that  the  respondent's  work  is 
kept  to  a minimum  (he  has  merely  to  place  a tick  in  the  most 
appropriate  box)  and  that  both  he  and  the  analyser  of  the  question- 
naire know  exactly  where  to  look  for  these  response  bo;:ee.  If 
response  boxes  are  used  it  must  be  made  abundantly  clear  Urat  a 
tick  (/)  in  the  box  indicates  the  chosen  answer,  aa  come  respon- 
dents are  given  to  putting  » laT.’-  v-t:  tie  be  < of  Vie 

unwanted  or  non-selectad  answer  - to  the  confusion  of  the  analyser. 
On  a similar  theme,  a statement  of  the  units  in  which  the  response 
is  required,  eg  'hours',  'days',  etc  saves  time  and  avoids  confusion. 
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Ibur  furthar  statMMnta  ar«  nacaaMry  to  oeaplata  tha  qttaatlonnalrai 


tbaaa  arai 


a.  A raquaat  to  tha  raapondaat  to  chock  back  to  aaaura  that  ha 
has  aaswarad  all  tha  quastioas. 


b.  A aaaaaca  of  thaaks. 


c.  lha  aaao  aad  addrasa  of  tha  Trials  Taaa. 


d.  laatlj,  aad  aost  iaportaatlj,  thara  should  ba  claar  wrlttaa 
laatructioaa  talllac  tha  raapoadaat  whaa  to  eoqplata  tha  quaatloa- 
aalra  aad  what  to  do  with  it  whaa  coaplatod,  ia  tha  aaaa  aad 
locatioa  of  tha  paraoa  to  whoa  it  should  ba  (iToa  aad  tha  tiaa  by 
which  it  is  raquirad.  It  is  vital  that  this  iaforaatioa  ba  writtaa 
claar ly  at  tha  bolitoa  of  all  quastioaaairas. 


A aaapla  quastioaaairo  which  iacorporatas  aaay  of  thasa  raeoaawa* 
datioasi  suMastioas  aad  diffaraat  foras  of  quastioas  is  givaa  ia  ths 
Aaaax  (pacas  18-22). 

Bitios  Scalas 


A quastioa  aad  raspoasa  box  is  oaly  oas  of  savaral  tachaiquss  for 
obtaiaiBK  iaforaatioa.  As  ratiag  scalas  havs  baaa  quits  widaly  usad 
la  trials  of  aqulpaaat  it  is  worth  aakias  spacial  asatioa  of  thaa.  A 
ratios  seals  oftaa  coasists  of  a lisa  (oftaa  100  tm  loaf)  which  rapra- 
saats  a coatiooua  batwaaa  two  claarly  dafiaad  aad-poiats.  Dor  axai^a 
tha  aad-poiats  ai^t  ba  'axtraaaly  hot'  aad  'axtraaaly  cold'  aad  it  is 
assuaad  that  tharaal  asutrality  would  ba  iadlcatad  by  a aark  halfWay 
along  tha  lias.  Soaatiaas  iataraadiata  points  on  ths  lias  ara  Isballad 
or  tha  lias  ia  dlvidad  into  laballad  bozas.  Ibsra  is  ao  oas  oorraet 
tachniqua  and  ths  aatbod  chosaa  will  dapaad  oa  tha  natura  of  ths  para- 
aatar  aad  tha  psrsoaal  prafaraaea  of  tha  iavastigator.  A rating  seals 
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can  be  a useful  technique  for  obtaining  infoniation  in  certain 
contexts  but  there  are  many  provisos: 

a.  The  end-points  of  the  scale  aust  be  true  opposites,  eg  black 
and  white,  hot  and  cold;  avoid  opposing  hot  with  comfortable, 
cool  with  heavy. 

b.  Each  end-point  should  have  precisely  the  same  meaning  to  all 
respondents;  a very  difficult,  if  not  impossible,  thing  to 
achieve.  Careful  preliminary  trials  will  be  nscsssary  to  select 
those  parameters  which  can  elicit  useful  information. 

c.  The  end-points  should  preferably  be  absolutes.  Black  and 
white  qualify  here,  but  not  hot  and  cold  because  they  could  be 
hotter  or  colder  and  therefor*  nay  need  qualifying  descriptions. 

d.  Since  some  people  seem  incapable  of  dividing  a 100  mm  line 
into  two  approximately  equal  portions,  sons  investigators  choose 
to  include  a marked  mid-point.  However,  what  shad*  of  grey  is 
the  mid-point  of  black  and  white?  Is  akin  temperature  the 
neutral  point  between  hot  and  cold? 

*.  Probably  the  greatest  danger  in  the  use  of  rating  scales 
lies  in  their  spurious  air  of  accuracy.  To  say  that  Item  A is 
32.7  mm  bettor  than  Item  B on  a particular  parameter  appear* 
impressive  but  1*  of  little  value  unless  the  variance  of  the 
rating  is  taken  into  account,  1*  is  everybody's  rating  near  to 
this  figure  or  are  they  widely  scattered?  In  addition,  such  a 
measure  is  unnecessary  if  the  information  required  was  mrely 
whether  Item  A was  better  than  Item  B.  If  this  were  the  case 
then  a straight  question  to  that  effect  should  have  been  used. 

If  the  strength  of  preference  is  required  this  can  be  qualified 
by  the  use  of  boxes  labelled  'slightly  better  than  ....'  and 
•much  better  than  In  the  light  of  the  above  considerations, 


Hl^ 
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rating  nenlM  ahould  only  bo  uood  in  trloln  if  do  bottor  aothod 
eon  bo  found]  io  thoy  obould  roroly  bo  noodod. 


asDC  A aptsTiowma 


Pilot  Triolo 


I 


Vhon  tho  quoationnoiro  has  boon  aoaoablod  it  ia  noat  dooirabla 
that  it  ahould  bo  triad  out  on  a group  of  pooplo  oiailar  to  thoao  to 
whoa  it  ia  to  bo  adniniotorod,  io  a quastionnaira  doatinod  for  squadron 
airerow  ahould  bo  triad  out  on  squadron  airerow.  It  is  only  by  doing 
this  that  tho  orrora  snd  aabiguitios  of  tho  qnootionnairo  can  bo 
eoiractod  boforo  tins  and  of  fort  aro  wasted  on  tho  actual  trial.  Ono's 
eolloaguos  or  non-airerow  aro  not  a satisfactory  snbstituts  on  tho  pilot 
trial  as  thoy  nay  havo  dlfferont  knowladgo  and  vocabulary  fron  tho 
roapondonta.  Osnally  ono  rolovant  parson  actually  coaploting  ths 
quastionnaira  will  bo  worth  ton  othors  Just  'casting  thoir  oyos  ovor 
it*.  Any  inadoquacios  in  tho  quostionnairo  should  bo  corroetod  and, 
ideally,  tho  aodiflod  quostionnairo  tostad  again. 

Briofins  tho  SubJocto 

Tho  briefing  given  by  tho  Mals  Officer  to  tho  trials  subjects 
suat  bo  scnqiwlously  fair  and  objoctivo  to  guard  against  tho 
possibility  of  his  influencing  tho  results.  To  that  and,  it  should 
ba  wrlttan  down  and  road  out  to  tho  asoaatlod  subjects.  Tho  ideal 
would  bo  to  record  the  briefing  on  tape  and  play  this  to  tho  subjects  - 
this  procedure  onsuros  that  should  ths  briofiug  have  to  bo  given  noro 
than  once,  a quite  usual  occurrence,  it  will  bo  identical  each  tine. 
SislJsr  ext  re  so  care  will,  of  oonrso,  ba  nacossary  in  any  question 

t I 

and  answer  oossion  which  follows  tho  briofing. 

To  reinforce  tho  verbal  briofing  and  act  as  a ronindor  a written 
trials  instruction  ahould  bo  provided  for  retention  by  each  subject. 


1 

I 

I 
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I 
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Such  a written  briefing  ehould  b«  attached  aecurel?  to  everr 
queetlonnalre.  Do  not  take  It  for  granted  that  all  of  the  trials 
subjects  will  be  available  for  a personal  briefing  by  the  Trials  Team; 
leave t alcknass,  etc  often  preclude  this.  It  Is  therefor*  Important 
that  the  written  trials  brief  which  is  attached  to  each  questionnaire 
should,  although  short,  include  all  the  information  necessary  for 
the  subject  to  conduct  the  trial  as  Intended. 

The  verbal  briefing  of  trials  subjects  should  also  Include  a 
'run  through*  of  the  questionnai.e  to  ensure  that  the  subjects  are 
fully  aware  of  the  Information  being  sought  from  them  and  that  all 
questions  on  the  proforma  are  fully  understood. 

Both  verbal  and  written  briefings  should  Include: 

a.  A statement  of  the  purpose  of  the  trial  and  an  explanation 
as  to  why  a questionnaire  is  being  used,  without  giving  any 
information  as  to  the  expected  verdict  on  the  equipment. 

b.  Trials  procedure,  ie  period  of  wear,  order  of  wearing  etc. 

c.  Clear  Instructions  as  to  when  the  questionnaire  is  to  be 
completed  and  to  whom  it  ie  to  be  given. 

d.  A statement  that  the  information  which  the  respondent  gives 
will  be  used  solely  for  the  purposes  of  the  trial  and  will  not 
be  presented  anywhere  in  a manner  which  can  tie  it  back  to  him. 

e.  A reminder  that  his  personal  opinion  is  being  sought  and 
that  he  should  not  be  influenced  by  crewrooL.  chat,  ie  to  enter  on 
his  questionnaire  only  whst  he  has  experienced  himself  and  his 
ovn  opinions,  and  that  information  is  wanted  only  on  what  has 
happened  - not  on  what  ho  surmises  may  happen  in  other  circum- 
stances/roles/aircraft/climates. 


I 
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Ttbrlafliuc 

Tb  obtain  tha  uaclnuB  valua  froa  a trial  it  ia  uaeaaaary  for  aach 
individual  aubjaet  to  ba  dabriafad  privatalj  by  tha  Triala  Officar  or 
a naabar  of  hia  taaa  aa  aoon  aa  tha  trial  ia  eoaplatad. 

Whan  intaraadiata  quaationnairas  hava  baan  eoaplatad  by  tha  trials 
parsonnal  and  ratumad  to  tha  Trials  Officar  at  tha  aid-trial  point 
thasa  should  hava  baan  serutiniaad  by  tha  Trials  Officar  for  oaissions 
and  aabigttitias  prior  to  tha  final  dabriafing.  Scrutiny  of  intar- 
aadiata  quaationnairaa  can  oftan  iadicata  additional  quaations  which 
naad  to  bo  poaad  at  tha  final  dabriafing. 


During  tha  individual  dabriafing  tha  Trials  Officar  should  ansura 
that  tha  subjaeta*  final  q«iaationnalraa  ara  indaad  eoaplato  and  tha 
rasponaas  unanbiguous.  Oraat  ears  nust  again  ba  azarcisad  to  avoid 
bias  in  tha  woiding  and  infomation  of  any  quastions  put  to  hin  to 
clarify  or  supplanant  his  writtan  answors.  Tha  dabriafing  sassion  is 
also  tha  last  opportunity  to  aak  any  quaations  which  ara  not  on  tha 
trials  quostionnaira  but  which  hava  occurrod  or  arisan  during  tha 
eoursa  of  tha  trial.  If  tbora  ara  such  quastions  thay  should  ba  pra- 
parad  with  siailar  cara  to  thosa  in  tha  original  quostionnaira  to 
ansura  that  aach  supplanontary  quastion  is  askad  In  praeisaly  tha 
way  of  aach  subjact. 


Analrsia  and  Banort 

a.  AgajjQij^.  Whan  all  tha  qaastionnairos  hava  baan  ratumad 
tha  data  oust  ba  collatad  into  prasantablo  fom.  Tha  thraa  nain 
typos  of  data  can  ba  traatad  ia  diffarant  wayst 

(1)  fbrcad-choica  rasponaas  can  ba  azprassad  in  toms  of 
tha  nunbar  and/or  poroaataga  of  rasponsaa  in  aach  box.  It 
isi  of  coursoi  iaportant  to  quota  tha  sIm  of  tha  sanpla  so 
that  tha  figuraa  can  ba  avaluatad  in  contoxt. 


/ 


A 


(2)  Ratlnga  can  b«  avaragad  and  thaaa«  togatbar  with  an 
aatioiata  of  tha  ▼ariaaeat  praaaatad  in  tha  raport. 


It 


(3)  Tha  raaponaas  to  opan-andad  quaatlona  ara  rnthar 
hardar  to  analyaa.  Thap  ara  parhapa  baat  praaantad  bp 
quoting  azaaplaa  of  tha  aoat  conaon  tppa  of  rasponaa. 
Qualifying  aach  typa  of  raaponaa  by  tha  nuabar  of  paopla 
who  mada  it  can  ba  aialaading  aa  aany  raadara  of  tha  raport 
nay  draw  falaa  eoneluaiona  about  thoaa  raapondanta  who  did 
not  aaka  that  particular  typa  of  eoanont,  ia  paopla  nay  not 
maka  a particular  raaponaa  to  an  opan-andad  quaationi  not 
bacauaa  thay  do  not  aupport  it,  but  baeauaa  thay  forgot 
about  it  at  tha  tina  thay  wara  coaplating  tha  quaationnaira, 
Nora  aophiaticatad  atatiatieal  tachniquaa  for  analyaia  ara 
available  but  ara  battar  oarriad  out  ia  co-oparation  with 
a atatiaticiaa. 

b.  Hon-Baaponna.  Noa*raspoasa  ia  not  a randea  procasa,  and  a 
certain  group  of  paopla  who  fail  to  eom>lata  a quaationnaira 
any  bo  atypical  ia  their  viawa  and  tharaforo  abould  not  ba 
ignored.  T]iia  factor  ia  probably  a aiaor  one  la  Sarvico  trlala 
whore  tha  great  najorlty  of  a aaapla  will  reply,  but  if  tha  aoa- 
raaponaa  rata  la  high,  an  explanation  auat  ba  aought.  Ibr  axaapla, 
it  night  ba  found  that  a particular  group  of  paopla  wara  poatad 
before  the  trial  waa  coaplatad  and  thua  tha  aaapla  aight  no  longer 
ba  conaldarad  truly  rapraaantativa. 

c.  Tha  Banort.  One  convoniant  way  of  reporting  quaotloanalra 
data  ia  for  tha  forcad-cboica  and  rating  raaponsaa  to  ba 
auanarload  aaparataly.  It  ia  important  that  a coaplata  quaation- 
nalra  ahould  ba  included  in  tha  raport  aa  aaraly  quoting  particular 
quaatlona  out  of  context  any  ba  aialaading.  The  eorraet  inter- 
pretation of  tha  collated  data  will  depend  on  the  akiU  of  tha 
Triala  Toaa.  A wall  daalgnad  quaationnaira  ahould  give  clear 
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anewera  and  theae,  coupled  with  coomenta  on  the  aize  and  nature 
of  the  aample,  ahould  anaure  that  accurate  infcroation  la 
conveyed  to  the  trlala  aponaora.  Remember  that  the  report  muat 
be  underatood  and  acted  upon  by  non-experta  in  thia  particular 
field.  Wherever  poaaible  enaure  that  the  concluaiona  and  recom- 
mendationa  are  aiinple  and  explicit  (ie  avoid  'alttlng  on  the 
ferce'  unleaa  the  reaulta  are  49i51  or  cloaer). 

COWCLDSIOHS 

A well-couatructed  queationnaire  can.  when  uaed  in  a carefully- 
organlaed  trial,  provide  a great  deal  of  useful  data.  This  goal  la 
not  difficult  to  achieve,  but  all  those  who  construct  and  use  question- 
naires must  be  aware  of,  and  avoid,  the  various  pitfalla  which  lie  in 
their  path.  The  errors  which  are  most  likely  to  occur  are; 

a.  Errors  of  saapling,  eg  an  incorrect  or  too  email  a sample. 

b.  Ambiguous  questions,  eg  double  or  negative  questions,  poor 
definitions  etc. 

c.  Bias  in  the  questionnaire  design  or  wording,  eg  leading 
questions,  eaotlonal  words,  'halo*  effects  etc. 

d.  Bias  of  the  Trials  Team,  eg  the  respondents  being  aware  of 
the  opinion  of  the  Triala  Team  either  through  a biased  briefing 
or  questionnaire,  or  by  loose  t€dk. 

e.  Errors  of  analysis,  eg  non-response  being  ignored,  rating 
scales  being  taken  too  literally,  etc. 

f.  Faulty  interpretations  of  the  results,  eg  the  Trials  Team 
aasumlng  that  their  findings  apply  to  all  men  in  all  aircraft 
under  all  conditions. 
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NB  nil*  qtttatlomialrt  ia  uaad  aa  a vahlela  to  daaoaatrata  layout  and 
Tarioua  typaa  of  quaatlon  which  can  ba  uaad.  It  doaa  not  purport 
In  any  othar  way  to  ba  typical,  raal,  coaplata  or  ideal  In  ita 
aaquanca. 


nu  lOr  NO 


POSTAL  ADDRESS  OT 
THE  TRIALS  TEAM 


QUESTIONNAIRE « AERDC  TRIAL  OF  AIR  VIHTmTED  AIBCREN  COVERALL  (AVAC) 
(3a-T«»)  SUMMER  197^ 

Tha  Inforaatlon  givan  by  you  in  thla  quaationnalra  will  ba  uaad  only 
for  tha  purpoaa  of  thia  trial  and  will  not  ba  praaantad  in  any  fora 
froa  which  indivlduala  can  ba  idantlfiad.  Plaaaa  raapond,  whara 
appropriate,  by  putting  a tick  ( y ) in  the  aalactad  box. 


Naaa,  rank,  aquadron 


2 Airfield  froa  which  flying  recorded  hare  waa  dona 

3 Inclualva  dataa  eovarad  by  thia  proforaa.  froa  .. 


Inclualva  dataa  eovarad  by  thia  proforaa.  from 
to  


Approx  boura  of  wear  eoxarad  by  thia  proforaa. 
Ground  

Airborne  . 

5 

Aircraft  type  and  Nk  

6 

Craw  Duty,  if  'Other*  plaaaa  apacify 

....  Pilot 

□ 

Nbt 

□ 

AEO 

□ 

Othar 

□ 

Flaaaa  indicate  all  clothing  worn  uadar  tha  AVAC  during  thaaa 
triala  < 

Paraonal  jockey  atyla  undarpaata  | [ 
Paraonal  boxer  atyla  undarpanta  [ | 
Cotton  athlete  type  ainglat  | | 
Cotton  aircrew  tea  ahirt  I I 


/ 


7  Cont'd 


Otiwri  plMM  ■pacify 


8  la  the  «boT«  what  you  would  haa*  worn  oa  thaaa  aortiaa  If  you 
had  baan  waarlnc  tha  Me  2C  AVfi? 


□ 

■»  D 


If  'No',  plaaaa  daacrlba  tha  dlffaraaea  and  tha  raaaona  for  thaai 


9  Plaaaa  apaci  '.>  all  tha  elothlac  and  aqnipaaat  worn  orar  tha  AVACi 


■■t 


i 


10  Plaaaa  iadicata  by  a aaife  on  tha  Uaa  at  tha  appropriata  plaea 
tha  fraquaacy  with  which  you  aoraally  waar  tha  He  2C  AVS  at  thia  tiaa 
of  yaar  in  thla  thaatra  of  oparatioaa. 

alwaya  30)t  of  tha  tiaa  aarar 

j > ■ 


11  Bow  do  yon  rata  tha  ganaral  (ia  Boa-tharaal)  eoafort  of  tha 
AVAC7  Plaaaa  plaea  a nark  oa  tha  liaa  at  what  you  Judea  to  ba  tha 
appropriata  plaea. 

vary  coufortabla  vary  uacoafortabla 

I — j 


» 


" • 1 ■ » .•  j ■ 


^ ; 
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12  How  do  you  rat*  th«  thonul  coufort  outaido  tho  aircraft 
M_tha_^rougd  of  tha  AVAC  eoaparad  with  tha  Nc  2C  AVS  ard  Me  7A 
aircraw  eovarall  eoabinatlon? 


AVAC  vary  aueh  hottar  □ AVAC  alightly  coolar  □ 
AVAC  alightly  hottar  | j AVAC  vary  ouch  coolar  □ 
Both  aueh  the  aaaa  j | 


13  How  do  you  rata  tha  fabric  of  tha  AVAC  for  taar  raalatanca  aa 
coq^rad  with  tha  Me  7A  aircraw  eovarall?  Hark  tha  lina  in  what  you 
think  ia  tha  appropriata  apot. 


AVAC  tears  aueh 

aora  aaaily 


Both  aueh 

tha  aaaa 


AVAC  aueh  aora 
taar  raaiatant 


AVAC  taara  a bit 

aora  aaaily 


AVAC  bit  aora 
taar  raaiatant 


No.  of  tiaaa  tha  AVAC  waa  laundarad 


Plaaaa  specify  any  difficulties 


13  Is  coapatibility  of  tha  AVAC  with  other  aquipaant,  eg  Ilfa- 


proaarvar«  seat,  harness 1 satisfactory? 


I..  Q 

□ 


If  'No',  please  elaborate 


I 

f 

li 
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16  Bbs  th*  AVAC  fail*d/torn  aiqrwhcr*? 


If  'T**',  pl*as*  *laborat* 


...  □ 

«.  □ 


1?  If  you  ar*  r*aulr*d  to  w*ar  loa*  fora  of  Taatllatad  garMat  for 
flying  dutlaa.  would  you  pr*f*ri 

a.  Air  ▼•atllatad  alrcraw 
coT*rall  (AVAC) 

b.  Me  7A  eoTorall  with 
Me  2C  air  T*atilat*d 
eoTtrall 


l8  airaa  a coaplataly  fr**  cholc*  would  you  rontiaoly  waar  for 
flying  dutiaai 

a.  Air  raatilatad  airerow  eovarall  (AVAC) 

b.  Me  7A  cowarall  with  Me  2C  AVS 
c>  Me  7A  cowarall  aloa* 

d.  Son*  othar  gar«*Bt(a) 

If  'd'l  plans*  daacrib* 


19  What  ehaagas,  if  any.  would  you  auk*  to  tha  AVAC  if  you  war* 
raspeasibls  for  ita  furthar  daTalopaastf 


■f./f  / 

w 


..  ♦ 

’ X 


, ■ 


\ I" 


h ■'  ’/  '*'* 


□ □ I □□□□ 


20  It  70U  IwT*  aucgsatsd  efaugta  at  19  tlbort,  would  tlMlr 
laoorporatloB  affaet  your  ehoieo  in  Quootiou  17  and  18  abort?  If  to 
plaaaa  go  on  to  qnaatloa  21.  It  yoa.  what  would  your  eholea  than  bai 


(1)  Air  rontilatad  alroraw  oorarall 


(1)  Air  vaatllatad  alrertw  eorarall 


(2)  Me  7A  eorarall  with  Me  2C  AV8 

(3)  Me  7A  eoTorall  aloaa 

(4)  Soao  othar  garwat(a) 


21  Data  thia  quaatioimalra  waa  eoaplatad  

Thank  yon  for  your  oe>oporatioB.  Plaaaa  ehaek  carofuUy  that  you  hara 
anawarad  all  tha  quaatioaa  fully  aa  thia  will  aaalat  tha  Oparatioaal 
BaqulraaoBts  Braaoh  la  coalng  to  a daeiaioa  on  thia  Itan  of  aquipBaat. 
PUASI  BAND  ms  ICBM  NOW  TO  1001  SQOAIMOII  TSIAIS  LIA180M  OmCBB  - 
nt  Lt  I B Saady. 
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